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ABSTB ACT 

It was hypothesized that the Bransford-Pranks linear 
effect is an artifact of the aethod of presentation of stlanlus 
sentences and is unrelated to senantic processes* Subjects were given 
sentences containing the saie Inforaatlon in one of two ways* In a 
control condition, vhlch vas identical to the procedure used in 
earlier research, overlapping combinations of ideas were presented 
during learning and recognition; in an ezperiaental condition ideas 
were presented one at a tiae. Besults demonstrated that one*ldea 
sentences received significantly higher recognition confidence 
ratings in the experiaental condition, thus supporting the artifact 
interpretation* It was proposed that subjects assign recognition 
confidence ratings based on the probability that a sentence 
containing a certain nuiber of ideas could have occurred in 
acquisition. (Author) 
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Abstract 



It was hypothesized that the Bransford-Franks lim^ar effect is 
an artifact of the method of presentation of stimulus sentences and 
Is unrelated to semantic processes. Subjects were given sentences 
containing the same information in one of two ways. In a control 
condition, which was identical to the procedure used in earlier 
research, overlapping combinations of ideas were presented during 
learning and recognition; in an experimental condition ideas were 
presented one at a time# Results demonstrated that one^idea 
aantences received significantly higher recognition confidence 
ratings in the experimental condition, thus supporting the artifact 
Interpretation. It was proposed that subjects assign recognition 
confidence ratings based on the probability that a sentence containing 
a certain number of ideas could have occurred in acquisition^ 
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The Bransford-Franks Linear Effect: Integration or Artifact? 
Stuart Katz, Beverly Atkeson, and Joanne Lee 
Uoiversity of Georgia, Athens, Georgia 30602 

Recently Bransford and Franks (1971, 1972) carried out a series of 
eicperiments on the integration of seniantic information in sentences. Their 
findings revealed (a) that individuals are unable to distinguish between 
closely related sentences which they heard during an acquisition period and 
those not heard, and (b) that reported recognition of these sentences is a 
positive linear function of their "sentence complexity", i.e., the number of 
simple ideas contained in them. (This second finding will hereafter be 
referred to as the "linear effect.") On the basis of these findings, the 
authors argued that people spontaneously construct and store in memory a 
unilied semantic representation based on a series of related linguistic in- 
puts; little or no information about specific sentences, or specific ideas 
isolated from the complete representation, is retainc^i. To account for the 
linear effect they also maintained that recognition of new inputs depends 
on the number of ideas which the new inputs exhaust in the whollstic represen- 
tation. The larger the number of ideas in the new input, the smaller its 
deviation from what has been stored in memory and, hence* the more familiar 
it is. 

Other studies, however, have not entirely supported these arguments. For 
example, Reltman and Bower (1973) used the Bransford-Franks procedure with 
strings of letters or digits instead of sentences. They found, among other 
things, (a) that subjects could Indeed distinguish between strings presented 
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in acquisition ("old" strings) and those not presented ("new" strings) , (b) 
that a significant linear relationship occurred between number of items 
constituting a string and recognition ratings, even though natural language 
materials were not used, and (c) that this linear effect occurred separately 
for both old and new strings. In other relevant studies Katz (1971) and 
Katz and Grvenewald (1973) found a significant linear effect using either 
highly abstract sentences (e.g. , The original event created an unusual s tate in 
the structure of the system .) or "meaningless" sentences (e.g.. The so to which 
tehoed inow the feexteva voneed the tioc len ic the froo ^ the adex . ) And 
finally, Katz (1973) found that the linear effect disappeared entirely when sub- 
jects were asked to recognize whether sentences meant exactly the same thing as 
sentences seen in acquisition (and not whether they had actually experienced 
such sentences, as in the original research). The result of this last study 
was unexpected since the "meaning" instructions were considered more appropriate 
to a test of the Bransford-Franks model than the original instructions. 

For purposes of the present study, these findings demonstrate two 
things. First, they show that the linear effect is not solely a function of 
semantic processes because, on the one hand, the effect occurs when the 
stimulus materials contain little or no semantic information while, on the 
other, the effect can be made to vanish even when such information is avail- 
able under the most appropriate conditions. Second, the results weaken the 
hypothesis that the linear effect reflects the construction and storage of 
Integrated structures, whether semantic or not. As the Reltman and Bower 
data show, the effect occurs even under conditions in which subjects can 
discriminate the new from the old. Thus, virtually all old strings which 
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formed only a pare of an integrated structure received much higher ratings 
than the wholistic structure itself* if that structure happened to be new. 

It would appear then that the linear effect Is unrelated to the 
explanation which Bransford and Franks offered. The present study attempts 
to identify that aspect of the Bransford~Franks paradigm which may be 
responsible for the effect. It is proposed here that the finding is due to 
the method of presentation of stimulus materials . Let us examine, for the 
moment, the standard procedure used in t^ese experiments. Typically, complex 
sentences, such as The rock which rolled down the mountain crushed the tiny 
hut at the edge of the ^ea. , are analyzed into four simple declarative 
sentences, each of which expresses a single semantic idea. The simple one- idea 
sentences are then recombined into other sentences containing two, three ;> or 
all four of the ideas. A subset of the sentences thus generated is then %i:$&d in 
acquisition (see Procedure below for further details). This method assures the 
redundant, overlapping presentation of all the ideas in any complex sentence 
and, hence, the integration of its semantic content. However* the method 
also appears to add a new dimension to the task of recognizing such sentences* 
Subjects may also learn during acquisition that the ideas contained in the 
sentences ap_pear in various combinations and that the number of combinations 
varies across levels of sentence complexity. Therefore, they may be assigning 
ratings based, in part, on some sort of guessing strategy involving the com- 
binatorial properties of the acquisition sentences* For present purposes, 
the details of such a strategy need not be elaborated* although one possible 
strategy is described in the discussion section. It Is sufficient to point 
out here that, from a procedural perspective, the linear effect may ultimately 
be a result of the specific way ideas were communicated In acquisition, and 
nothing more* 



TUtz 



5 



Considerations of this sort suggested a very simple experinant, the 
outcome of which would support either the Brans ford-Franks model or the pro- 
cedural artifact interpretation proposed here. Subjects were given sentences 
under two procedures which differed in the way the same information was 
presented. In a control condition, subjects were given the standard procedure 
in fAildk one-, two-, three-, and four-idea sentences were presented. In the 
•atperimental condition, subjects were given only one-idea sentences. The 
integration of the ideas into complete semantic representations is possible 
in both conditions (though, perhaps, more difficult in the experimental con- 
dition) since even one-idea sentences contain semantic links to other 
sentences. If the Bransford-Franks hypothesis is correct, subjects in 
both conditions should construct wholistic representations, store these, and 
later utilize them as a basis for recognizing new sentences. Specifically, 
one-idea sentences should receive the lowest recognition ratings since, 
according to the model, they "exhaust" the smallest amount of information 
in the unified representation. Furthermore, the results should not differ 
between the experimental and control conditions. If, however, the linear 
effect is due to the particular method of presentation of acquisition 
sentences, then the recognition of one-idea sentences should be different 
in the two conditions. In the control condition, which is simply a replication 
of the original research, one-idea sentences should receive the lowest ratings 
relative to other sentences as has been found in the earlier stiidies. In 
the experimental condition, however, subjects are, according to this hypothesis, 
no longer rei^uired to decide whether a particular idea appeared alone pjr in 
combination with. other ideas. If we assume that subjects are, nonetheless. 
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completely faoiliar with the ideas, the ratings for one-idea sentences should 
be significantly higher than their counterparts in the control condition. 

Before either of the above conclusions can be drawn, it ia necessary 
to demonstrate that subjects in both conditions understand the relationships 
among ideas in each of the unified representations; i.e., subjects must be 
able to know what ideas go with what. Without such understanding, of course, 
the spontaneous Integration of the ideas cannot take place. In order to 
evalxiate subjects' knowledge of these relationships, two other groups were 
given the experimental and control acquisition procedures, respectively, and 
then directly tested for such knowledge. Both groups were given a special 
class of sentences called "noncases", employed first by Bransford and Franks 
(1971). The semantic representations of noncases are incompatible with the 
meaning of the unified representations and should be rejected if subjects 
understand the interrelationships among ideas. The two groups must be 
comparable in detecting noncases before any firm conclusion regarding the 
competing hypotheses can be made. 

METHOD 

Subjects 

Subjects were 48 volimteers from two undergraduate psychology courses 
at the University of Georgia. 
Materials 

Stimulus materials consisted of a set of four complex embedded English 
sentences, each containing four unambiguous ideas. Three of the four 
complex sentences were similar to those used by Bransford and Franks (1971). 
They are as follows i (a) The rock which rolled down the countatn crushed 
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the tiny hut at the edge of the sea * , (b) The barking dog chased the brovm cat 
vhich lunped on the girl .. Cc) The ants in the kitchen ate the sweet jelly 
which was on the newspaper . . (d) The thunder crashing through the valley 
shook the tinkling bells in the come *'.. . Each complex sentence was analyzed 
icto four simple declarative sentem These latter sentences expressed, in 
appropriate grasmiatical form, a single semantic idea. Thus, The rock which 
rolled douTi the mountain crushed the tiny hut at the edge of the sea . , was 
partitioned into The rock rolled down the mountain . , The rock crushed the 
hut . , The hut was tiny . , and The hut was at the edge of the sea . . The simple 
declarative sentences, or ONEs, were then recombined into new sentences 
expressing two ideas (TWOs), three ideas (THREES), or four ideas (FOURs) . The 
sentences generated by the partitioning and recomblnlng procedure will be 
referred to as an "idea group". In addition, four "noncases" were constructed. 
A noncase was defined as a FOUR in which relationship among gr amma tical units 
were changed so as to change the meaning of the sentence. The noncases were: 
(a) The barking dop which chased the brown cat lumped on the girl . , (b) The 
ants on the n ewspaper ate the sweet lellv which was in the kitchen . , (c) The rock 
which rolled down the mountain shook the tinkling bells in the comer . , <d) 
The barking dog chased the brown cat which was on the newspaper . 

1. Control condition . The acquisition list for this condition con- 
tained a single ONE, TWO, THREE, and FOUR from each idea group, resulting 
in 16 sentences. Vlhenever there was more than one to choose from, selection 
was carried out randomly. With the constraint that no two sentences from 
the same idea group should appear consecutively, the 16 sentences were 
randomized for presentation during acquisition. 
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The recognition list contained the same sentences «& the acquisition 
list although the sentences appeared in a different, randocdy generated order. 

2* Experimental condition . In this condition both the acquisition and 
recognition lists were composed exclusively of the ONEs in each idea group. 
Thus, 16 sentences appeared on each list, as in the control condition. Again, 
no two sentences from the same idea group appeared consecutively and a 
different random order of ONEs was used for acquisition and recognition, 
respectively. 
Procedure 

With the exception of the type of sentence lists constructed, the pro- 
cedure closely paralleled that used in Bransford and Franks (1971) for both 
experimental and control conditions. The experimental session was carried 
out in two phases, acquisition and recognition. 

Acquisition . Acquisition Involved an incidental learning task. 
Xn addition to a standard set of instructions S^s were also told that 
sentences they were nbout to hear were related* This waa done to aid 
integration. Subjects, in groups of two or three, first listened to sentences 
read by the experimenter; each sentence was then followed by a 4-5 sec. 
interval in which Ss counted out loud the number of fingers on the experimenter's 
right hand. After the interpolated task, Ss wrote down what they heard. 
This procedure was repeated for each of the 16 sentences on the acquisition 
list. Appropriate counterbalancing was used to control for possible order 
effects In list presentations. When the list was completed^ Sjs rested for 
five min. without conversing. During acquisition no mention was made of any 
recognition test. 

2, Recognition . During recognition £s were told thot • new set of 
sentences would be read to them and that these sentences were closely related 
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to the set of sentences presented in Acquisition. Their task was to indicata 
which sentences they had actually heard before and which ones they had not. 
For each sentence subjects indicated whether they recognized it or not by 
first marking a YES-NO scale and then a five-point confidence scale ranging 
Iron "very low" to "very high" confidence. This procedure was repeated for 
each of the recognition sentences. 

Evaluating integration . As in earlier studies, noncases ware used 
to evaluate £s' ability to distinguish aaiong sentences whose ideas are, 
or are not, consistent with the whoiiatic representation established in 
acquisition. However, unlike earlier studies, noncases could not be in- 
serted into the ejcperimentsl condition recognition list because Ss experienced 
only ONES during acquisition. As Brsnsford and Franks (1972) demonstrated, 
subjects also retain memory for the "style" of sentences they learned so 
that noncases would certainly be rejected on that basis alone; they are 
much different in structure from the ONEs. Therefore, two additional groups 
of were used to separately evaluate their ability to detect deviat;:ons in 
meaning from the complete semantic repreaentatlons. These groups were given 
the experimental and control acquisition lists respectively. They were then 
presented with eight sentences, four noncases and four FOtlRS. The Ss were 
asked simply to rate the sentences according to whether they were "consistent" 
with sentences they heard earlier. In this way, Ss were expected to attend 
to meaning only, ignoring stylistic differences. Instructions similar to 
these were effectively used elsewhere (Katz, 1973). As in the recognition 
conditions for the main part of the experinent, Ss rated sentences by marking 
YES-KO and confidence scales. 



ERIC 



n 



Katz 



RESULTS 



20 



Data on Sentence Recognition 

The dependent measure used In the present experiment was mean recognition 
confidence score, deters&lned as follows: Each £*8 response to the YES-NO and 
confidence scales for each sentence were converted into a single rating. A 
plus C-f) was assigned to a YES response and a minus (-) to a 210 response. The 
'f or - was multiplied by the S^'s numerical response to the confidence scale 
for that sentence. This resulted in an 11 point recognition confidence scale 
ranging from -5 to -t-S. In the coutrol condition, each of these ratings was 
pooled for FOURs, THREES » TW)b, and ONSs. In the experiflental condition* all 
ratings were pooled Into a single group since* of course* all the sentences 
Ss rated were~ old ONES. 

^« Replication of linear effect . Mean recognition confidence ratings 
in the control condition were 3.A8, 7.96* 2.04, -l.IO for FOU&s* THREES* 
TWOS* and ONEs respectively. The data for the control condition were cast 
into a single factor repeated measure design with "sentence complexity" 
(FOURS* TBREEs* TWOs, and ONEs) as the factor. An overall analysis of variance 
yielded a significant F ratio for sentence complexity. A trend analysis was 
r^arried out on the same data and a significant lisMor trend was found for 
sentence complexity t F^(l»33)* 15.42* .001. Therefore the control condition 
replicates the flndlngts of Bransford and Franks (1971) • 

2. Comparison of experimental and control conditions . The crucial 
ccaparison in the present study was between the ratings for aU sentences in 
the experimental condition (these were entirely ONE«) and the ratings for ONEs 
in the control condition. The means for ONEs in tbft experisental and control 
conditions were 3.31 and -1.10 respectively. The difference between these 
means was hl^ily significant* t.(22> • 4.70* £< .001. Thus, sentences in the 
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ejq>erlmental condition received ratings significantly higher than sentences 
in the control condition. f' 
£val,uating Integration; Noncases ' 

The means for noncases in the experimental and control conditions wore 
-1.59 and -1.86 respectively and they were not significantly different, 
^(22) " 0.52, £<.50, Therefore, the null hypothesis that recognition confidence 
ratings for experimental subjects do not differ from those for control 
subjects cannot be rejected. 

DISCUSSION 

It was hypothesized that the linear effect, i.e., the linear relationship 
between recognition confidence ratings and the number of ideas in recognition 
sentences, is a function of the mode of presentation of acquisition sentences, 
not of semantic processes. To test this hypothesis, two different types of 
acquisition lists were used within the standard Bransford Franks format. 
In a control condition, sentences were presented that varied in the number of 
ideas each contained. In the experimental condition, only ONEs, or single- 
idea sentences were presented. According to Bransford and Franks (1971, 1972), 
either method should, in principle, result in the formation of wholistlc 
semantic representations which, in turn, should provide the basts for 
recognition of new sentences. Thus, recognition confidence ratings for old 
ONES ought to be identical regardless of which acquisition list is employed. 
According to the procedural artifact hypothesis proposed here, ONEs in the 
experimental condition should be significantly higher because subjects 
are no longer required to remember what the precise combinations of ideas 
were in acquisition. They need only remember whether they saw the ideas 
at all. The results unequivocally support the artifact hypothesis; ONEs in 
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the experimental condition received high positive recognition confidence 
retings comparable to the highest ratings in the coitrol condition and 
significantly higher than old ONEs in the control condition. Furthermore, 
since subjects who experienced either the experimental or control acquisition 
lists did not differ significantly in their ability to detect noncases, the 
difference in recognition of ONEs cannot be attributed to differences in 
degree of integration between the two conditions. 

Perhaps y however, the results are due to other differences between the 
experimental and control conditions. Three are apparent. First, acquisition and 
recognition sentences differ In length for the tvo conditions. In the 
experimental condition sentences are short and roughly of comparable length; 
in the control, sentences vary in length, some being quite long (the FOURfii) 
and others short (the ONEs). Second, the two conditions differ in the 
frequency with which simple ideas were presented in acquisition. In the 
experimental condition, each simple idea appeared only once, while in the 
control, each appeared at least twice and often three time^. Neither of 
these differences, length nor frequency, can be plausibly connected to the 
results. In fact, the argument could be made that they would lead to findings 
opposite to those observed here. * However, a third difference could reasonably 
account for the findings. It will be recalled that the mean recognition 
confidence rating for ONEs was based on 16 sentences In the experimental 
condition and on only four in the control. Singer and Rosenberg (1973) 
have recently shown that ratings among ONEs differ considerably as a function 
of the grammatical relations existing between simple ideas and the FOUKs- 
from which they are derived. Thus, for example, ONEs which express the 
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suoject-object relation of the main clause of a FOUR ("MAINs") are likely 
to receive much higher ratings than ONEs which do not contain this relation. 
If, in the present study, ONEs in the control condition contain relatively 
unimportant relations , their ratings might be lower than ONEs in the 
experimental condition (four of which contain the important MAIN relation) 
for this reason. Inspection of the ONEs in the control condition revealed, 
however, that three contained the important MAIN relation. Therefore, the 
difference in ratings between ONEs in the two conditions cannot be accounted 
for in this way.^ Since it could atlll be argued that other, unspecified, 
differences between eacperimental and control ONEs are responsible for the 
findings, the ratings for the control ONEs were compared to the ratings for 
the same four ONEs in the experimental condition. The means were 3. 44 for 
the experimental condition and -1.10 for the control, and their difference 
was highly significant, t(22) - 4.58, p < .001. Therefore, even when identical 
ONEs in the two conditions are compared, the results are the same. In sum, 
there appears to be no way to account for the results other than by the dif- 
ferences in the wa> ideas were coinbined in the two conditions. 

Though the present stud^ suggests the probable source of the linear 
effect, no precise explanation has been offered as to why the particular 
acquisition procedure used by Bransford and Franks should invariably produce 
such a relationship. A relatively simple hypothesis offered here is that 
subjects assign ratings based on the probability that a sentence having a 
particular number of ideas could have occurred in acquisition. They would 
do this, presumably, by estljaatlng the total possible t^umber (or "set size") 
of sentences of varying sentence complexity and then formulating u probability 
based on the inverse of that set size. The linear effect itself can thus 
be easily explained: Since the maximum net aise is greatest for ONEs and 
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ratlxigs would yield a reverse ordering* i.e., ratings would be greatest for FOURs, 
and least for ONEs. The hypothesis can also explain other related findings in- 
cluding those where the positive linear relationship is not obtained. Two invest- 
igations are mentioned here. In the Reltman & Bower (1973) study described earlier, 
a "random" condition was included in which strings of elements (letters or digits) 
of differing lengths were generated by randomly grouping elements without regard 
to order or type of element. Under these circumstances all permutations and com- 
binations of elements are permissible so that the set size for FOURs becomes the 
largest and the set size for ONEs the smallest. If our hypothesis is correct, 
ratings for those strings should yield a "reverse" linear effect; those for ONEs 
should be highest and FOURs smallest. This is exactly what Reltman & Bower 
<X973) found. Bransford and Franks (1972) report a related study in which the 
basic ideas of several whollstlc representations were presented "unconstrained" 
In acquisition; i.e., the basic ideas were combined in ways which cut across 
whollstlc representations. This manipulation Increases the potential number 
of sentences of higher complexity relative to those of lower and, according 
to our hypothesis, should change the slope of the sentence complexity curve 
so that ratings of sentences of greater complexity decrease while those of 
les»er complexity increase. Results of the study showed the slope of the 
curve to be virtually zero, a change in a direction consistent with the 
hypothesis. We should point out that the curve would not be expected to 
reflect a completely reverse ordering in the ratings, as in the Reltman and 
Bower (1973) study, because the unconstrained condition permitted only a few 
additional coBibinatlons (and no permutations) of basic ideas relative to the 
standard procedure. As a result, the set sizes of higher complexity sentences 



vere ouch smaller than those of the higher complexity letter or ntuaber strings 
in Reltnan and Bower (1973). 

It remains for us to consider the general question of why subjects might 
assign ratings using this "statistical" method rather than attempt a precise 
identification of each sentence during recognition. In fact, subjects prob- 
ably do try to make exact identifications. However, except in the cases where 
there are major changes in meaning (as with noncases) or in syntactic style 
(Katz, 1973), or perhaps where the amoxint of information contained in the 
»tl»ulus material is relatively small (Reitman and Bower, 1973), precise 
recognition becomes especially difficult. Therefore, subjects must resort to 
tome other way of assigning ratings. The strategy we have described seems 
most plausible because while the presentation of redundant, overlapping ideas 
is difficult for subjects vis-a-vis the recognition of particular sentences, 
that very same procedure is quite clear in suggesting the way in which the 
various simple ideas go together and, as a consequence, how sentences express- 
ing part or all of a wholistic idea can be generated. Once subjects know this, 
it it a relatively simple matter for them to formulate the requisite probability 
estimates and the corresponding recognition confidence ratings* 
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2lndeed, it would be expected that control ONES would show 

the higher ratings since three out of four of them contain the 

MAIN relation as compared to four out of 16 for the experimental 

ft 

ONES. 
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